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Abstract 

We analyze opportunistic schemes for transmission scheduling from one of n homogeneous 
queues whose channel states fluctuate independently. Considered schemes consist of the LCQ pol- 
icy, which transmits from a longest connected queue in the entire system, and its low-complexity 
variants that transmit from a longest queue within a randomly chosen subset of connected queues. 
A Markovian model is studied where mean packet transmission time is and packet arrival rate 
is A < 1 per queue. Transient and equilibrium distributions of queue occupancies are obtained in 
the limit as the system size n tends to infinity. 



*An earlier version of this manuscript appeared at the Information Theory and Applications Workshop, UCSD, 
2008. 



1 Introduction 



We analyze a queueing system that arises under opportunistic scheduling of packet transmissions from 
a collection of queues with time- varying service rates. The system of interest is motivated by cellular 
data communications in which a single transceiver serves multiple mobile stations through distinct 
channels. Transmission scheduling has been well-studied in this context under the guiding principle of 
opportunism, which broadly refers to exploiting channel variations to maximize transmission capacity 
in the long term. In this we paper consider two generic opportunistic scheduling policies and obtain 
asymptotically exact descriptions of the resulting queue length distributions in symmetric systems 
of statistically identical queues. 

Explicit analysis of queue lengths under opportunistic scheduling is generally difficult due to model 
complexities and lack of closed-form expressions. In related work Tassiulas and Ephremides [10] 
considered a queueing system under an on/ojff channel model in which each queue is independently 
either connected, and in turn it is eligible for service at a standard rate, or disconnected and it cannot 
be serviced. It is shown that transmitting from a longest connected queue stabilizes queue lengths if 
that is at all feasible, and that it minimizes occupancy of symmetric systems in which queues have 
identical load and channel statistics. This policy is coined LCQ. Explicit description of queue length 
distributions under LCQ is not available, but several bounds for mean packet delay are obtained 
in [21 [6] for LCQ and some of its variants. In more general models that admit multiple transmission 
rates and simultaneous transmissions, max-weight scheduling policies and their variations are shown 
in [9l[7| to asymptotically minimize a range of occupancy measures along a certain heavy-traffic limit. 
In the special case when one queue can transmit at a time, max-weight transmits from a queue that 
maximizes the product of instantaneous queue length and transmission rate. Tails of queue length 
distributions under such policies are studied in [HJ [12] via large deviations analysis. 

Here we consider a system of n queues under an on/off channel model in which each queue is 
connected independently with probability g G (0, 1]. A continuous-time Markovian model is adopted 
where packet transmission rate is n and packet arrival rate is A < 1 per queue. It can be seen that 
A is also the load factor of the system; hence the condition A < 1 is necessary to have positive- 
recurrent queue lengths. We analyze this system for large values of the system size n, under the 
LCQ scheduling policy and under its low-complexity variant, namely LCQ{d), that transmits from 
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a longest queue within d>l randomly selected connected queues. It is apparent that LCQ{d) is not 
particularly suitable for non-symmetric systems, yet our goal here is to obtain a generic evaluation 
of its underlying principle, which may be tailored to specific circumstances. 

We establish that as the system size n increases equilibrium distribution of queue occupancies 
under the LCQ policy converges to the deterministic distribution centered at 0. Hence asymptotically 
almost all queues are empty in equilibrium. The number of queues with one packet is 0(1) and the 
number of queues with more than one packet is o(l) as n — oo. In particular maximum queue size 
tends to one. The total number of packets in the system is therefore given by the number of nonempty 
queues, and this number is shown to have the same equilibrium distribution as the positive-recurrent 
birth-death process with birth rate A and death rate 1 — (1 — qy at state j G Z+. Note that the 
latter rate is equal to the probability of having at least one connected queue within a given set of j 
queues, and that the nature of the total system occupancy may be anticipated once maximum queue 
size is determined to be one. The obtained description leads to asymptotic mean packet delay via 
Little's law as the rate of packet arrivals to the system is readily seen to be nX. 

The analysis technique applied to LCQ can be extended, although with excessive tediousness, to 
symmetric max-weight policies in cases when each queue can be serviced independently at rate nR 
for some random variable R. Above conclusions about LCQ offer substantial insight about queue 
occupancies in that more general setting. Namely if R exceeds A with positive probability (note that 
this condition is necessary for positive recurrence of queue lengths), then stochastic coupling with 
a related LCQ system yields that the maximum queue length in equilibrium tends to 1 as n — ^ oo. 
In turn, equilibrium distribution of total system occupancy should be expected to resemble that of 
a birth-death process with birth rate A and death rate £'[max{i?i, i?2, • • • ,Rj}] at state j, where 
Ri,R2,- " jRj ai'e independent copies of R. 

We obtain the equilibrium distribution {pk}'^Q of individual queue occupancy under the LCQ(d) 
policy in the limit as n — ^ oo. Specifically Pk = — vl_^_i where Vq = 1 and 



This distribution is shown to have tails that decay as 6((A/o?)'^) as queue size k ^ oo. Hence, in 
terms of tail occupancy probabilities, the choice parameter d has the equivalent effect of reducing 
the system load by the same factor. Yet, for any fixed d, system occupancy under LCQ(d) is larger 
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(a) LCQ (b) LCQ(d) 

Figure 1: Mean packet delays as n — > oo. Note the normalization in (a). 

than that of LCQ by a factor of order n. Numerical values of asymptotic mean packet delay under 
LCQ and LCQ((i) are illustrated in Figured) We also conclude that if d is allowed to depend on n 
so that d ^ oo but d/n ^ then order of the alluded disparity reduces to n/d. This suggests that 
for moderate values of d and n LCQ((i) and LCQ may be expected to have comparable packet delay. 

The present analysis is based on approximating system dynamics via asymptotically exact differ- 
ential representations that amount to functional laws of large numbers. Hence besides the mentioned 
equilibrium properties the paper also describes transient behavior of queue occupancies. The present 
analysis of LCQ((i) is inspired by the work of Vvedenskaya et al. [11] which concerns an analogue 
of this policy that arises in routing and load balancing. It should perhaps be noted that the choice 
parameter d appears to have a substantially more pronounced effect in the routing context. Our 
conclusions about the LCQ policy require a more elaborate technical approach. Here we apply 
a technique due to Kurtz [5j to obtain a suitable asymptotic description of the system. Related 
applications of this technique can be found in [H (U [13] . 

The rest of this paper is organized as follows. We continue in Section [2] with formal description 
of the model and the notation adopted in the paper. The policies LCQ((i) and LCQ are analyzed 
respectively in Sections [3] and HI The paper concludes with final remarks in Section [5j 
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Figure 2: Sketch of the considered queueing system. At most one queue is serviced at a time, and 
each queue i can be serviced only when channel i is eligible for transmission. 

2 Queueing Model 

Consider n queues each serving a dedicated stream of packet arrivals as illustrated in Figure [2j 
Arrivals of each stream occur according to an independent Poisson process with rate A < 1 packets 
per unit time and transmission time of each packet is exponentially distributed with mean n~^, 
chosen independently of the prior history of the system. Each queue is serviced by a designated 
channel but at most one channel can transmit at a time. Channel states fluctuate randomly and 
each channel is eligible for transmission with probability q £ (0, 1] independently of other channels. 
Queues with eligible channels are called connected. We assume that channel states remain constant 
during packet transmission and that they are determined anew, independently of each other and of 
the current queue lengths, just before the next transmission decision. 

Let mfc(t) denote the number of queues with k or more packets at time t, and let 

Uk{t) = , A; = 0, 1,2, - • • . 

n 

be the fraction of such queues in the system. In particular 

l = uo{t)>ui{t)>--->0, (1) 

the sequence {1 — Uk{t)}'^^Q is the empirical cumulative distribution function of queue occupancies, 
and X]fc>i^tfc(i) is the empirical average queue occupancy in the system at time t. We denote by 



Pn and En respectively probabilities and expectations associated with system size n. In particular 
if qi(t) denotes the occupancy of the i-th queue at time t then by the symmetry of the model 

En[Uk{t)] = Pn{qi{t) > k). 

Let U denote the collection of sequences u = {ufcj^o satisfy relation ([1]), and endow U with 
metric p that is defined by 

p(u, u)=sup ; , u, u G (7. 

fc>o k 

Note that convergence in U is equivalent to coordinate-wise convergence, and that U is compact as 
each coordinate lies in a compact interval. 

For each time t let u{t) denote the sequence {uk{t)}^=Q- We represent the trajectory (u(t) : t > 0) 
by the symbol u(-), and say that u(-) converges to a given trajectory v(-) uniformly on compact time- 
sets (uoc) if for all t > 

sup p(u(s), v(s)) ^ a.s. as n — > oo. 

Q<s<t 

3 LCQ((i) 

We focus on LCQ((i) which randomly and independently selects d connected queues and transmits 
from a longest queue within this collection. For convenience of analysis we assume that repetitions 
are allowed in the selection procedure, and that if all selected queues are empty or no connected queue 
exists at a scheduling instant then the scheduler makes a new selection after idling for the transmission 
time of a hypothetical packet. This latter assumption can be seen to imply that scheduling instances 
form a Poisson process of rate n. 

For A: = 1, 2, 3, • • • let = {efc(i)}^o where 

ek{i) = l{i = k}. 

Here and in the rest of the paper !{•} denotes 1 if its argument is true and otherwise. Jumps of 
the process u(-) are of the form ibn~^efc for some k. Namely u(-) changes by +n~^efc whenever some 
queue with exactly k — 1 packets has a new arrival, and by — n^^e^ whenever a packet transmission is 
scheduled from a queue with exactly k packets. The number of queues with k — 1 packets at time t is 
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given by n{uk-i{t) — Uk{t)); hence the former event occurs at instantaneous rate n\{uk-i{t) — Uk{t)). 
The latter event occurs if and only if, upon completion of a packet transmission, {i) there exists a 
connected queue and {ii) the scheduler inspects at least one connected queue with k packets but none 
with more than k packets. To determine the instantaneous rate of this event let r be a scheduling 
instant and let 

a, = 1 - (1 - qY. 

Namely a„ is the probability that there exists a connected queue at time r. Since channel states 
are assigned independently of queue lengths at time r, a connected queue at this time has strictly 
less than k packets with probability 1 — Uk{T). Therefore, given that a connected queue exists, 
the maximum queue length inspected by the scheduler is equal to k with (conditional) probability 
(1 — nfc+i(T))'^ — (1 — Uk{T)Y. Since scheduling instants occur at constant rate n, instantaneous rate 
of transmissions from a queue of size k is na„((l — Uk+i{t))'^ — (1 — Uk{t))'^). In particular u(-) is a 
time-homogeneous Markov process whose generator can be sketched as 

{u + n~^efc at rate n\iuk-i — Uk) 
k = l,2-- - . (2) 
u-n^^Bk at rate na„((l - n^+i)'^ - (1 - n^)'^). 

It offers some convenience in the subsequent discussion to represent the process u(-) via the 
"random time change" construction of [21 Chapter 6] . Namely 

u{t) = u(0) + ^ n^-^efcvlfc-i ^nA y Uk-i{s) - Uk{s)ds^ 

- n'^^kDk [nan Uk+i{s)Y - (1 - Uk{s)Yd^ 



(3) 



where Ak-.i{-)^ Dk{-), k = 1,2, ■ ■ ■ , are mutually independent Poisson processes each with unit rate. 
In informal terms, the processes Ak{-) and Dk{-) clock respectively arrivals to and departures from 
some queue with length k, and the construction ([3]) is based on suitably expediting these processes 
to match the instantaneous transition rates given in ([2]). Martingale decomposition of the Poisson 
processes used in ^ yields 

t , 

- Wfe(s))ds - an((l - Uk+i{s)f - (1 - Uk^s)f) ) ds + e{t), (4) 



u(t) = u(0) + J]efe / (a( 
fc=i -^0 ^ 



where = {efc(i)}fcLo such that each coordinate process efc(-) is a real-valued martingale adapted 
to the filtration generated by u(-). 



Theorem 3.1 Every subsequence of {n} has a further subsequence along which u(-) converges in 
distribution to a differentiable process v(-) such that vo{t) = 1 and 

^Vk{t) = X{vk-i{t) - Vk{t)) - {I - Vk+i{t))'^ + {1 - Vk{t))'^ k = l,2---. (5) 



Proof. The sequence of processes u(-) : n = 1, 2, • • • is tight in the Skorokhod space Du[0, oo) 
of right continuous functions with left hmits in U [2, Chapter 3.5]. Therefore every subsequence 
has a further subsequence that converges in distribution. By Skorokhod's Embedding Theorem [21 
Theorem 3.1.8] the processes can be reconstructed in an appropriate probabihty space if necessary 
so that the convergence occurs almost surely. Since jumps of u(-) have magnitudes that scale with 
n~^, the limit process is continuous and convergence of u(-) can be taken uoc [2, Theorem 3.10.1]. 
To describe a limit process v(-) note that UQ{t) = 1, and so £o{t) = 0. For A; = 1, 2, • • • the martingale 
£k{-) is square integrable. This process has 0{n) jumps per unit time and each jump is of size n~^, 
hence its quadratic variation vanishes as n — > oo. In turn, Doob's -L^ inequality [2, Proposition 
2.2.16] implies that £k{') uoc as n ^ oo. Since a„ 1 and convergence of u(-) is uoc, the kth 
integral in equality (jl]) converges to 

1^ [\{vk-i{s) - Vk{s))ds - ((1 - Vk+i{s)y - (1 - Vkis))'')) ds. 

Therefore v(-) satisfies equality ^ with a„ = 1 and e{t) = 0. Diff^erential representation of that 
equality is ([5]). □ 



Let Uo denote the set of system states in which average queue occupancy is finite. That is, 

oo 

Uo = {u. £ U : ^^ifc < oo}. 
k=l 

Let V* = {f^l^o ^ U he defined by setting Vq = 1 and 



vl = l-^l- Xvl^„ k = l,2,.... (6) 

Since 1 — ^1 — Au^_-^ < Av^_^ it follows that < X''; in particular v* G Uo- It can be readily 
verified by substitution that v* is an equilibrium point for the differential system ([5]). The following 
lemma establishes that v* is the unique stable equilibrium for trajectories that start in Uo- 
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Lemma 3.1 Let v(-) solve the differential system with initial state v(0) € Uq- Then 

]iuivk{t)=vl fc = l,2,---. (7) 



We provide a proof based on the following auxiliary result: 

Lemma 3.2 Lei v^(-) andv~{-) solve the differential system ^ with respective initial conditions 
v+(0), v-(0) G U such that t'^(O) > v^{0) for all k. Then v^{t) > v~^{t) for all k and all t > 0. 

Proof. Suppose that the lemma is incorrect and let t > be the first instant such that 

(t) = v^{t) and ^^'fc (*) < ^""fc (*) ^• 
Let i be the largest index k that satisfies this condition at time t. Then by ([5]) 

j^vtit) - j^vr{t) = \{vU{t) - vf_,{t)) + (1 - vf^,{t))^ - (1 - vt,,{t)Y: 

The right hand side of this equality is nonnegative due to the choice of t (since otherwise either the 
condition vf_i{t) > v^_-^^{t) and or the condition vf_^_i{t) > v^^-^^{t) must be violated before time t). 
This contradicts with the definition of t; therefore no such t exists and the lemma holds. □ 

Proof of Lemma 13.11 Let v+(-) and v^(-) be solutions to dSJ with respective initial states 
v''"(0) and v^(0) that are defined by setting v^{0) = max{wfc(0), ti^} and v^{0) = min{ffc(0), f^} for 
A; = 0, 1, 2, • • • . By Lemma [ 



d 



dt 

i=k 



Vk{t) < Vk{t),vl < v+it), forallA;,t. (8) 
Equality and definition of v* give 

oo 

■Y^vfit) = xvi^{t)+{i-v^{t)r-i 

= X{vt,{i) - ^l-i) + (1 - - (1 - ^D", 

or, in integral form, 

oo oo „i .f 

E^?W-E^?(0)= / Kvtii^) - vl^,)ds + / {{l-v^{s)r-{l-vl)')ds. 

i=k i=k 
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(9) 



Note that since vf{t) > = 1 — \/l — X it follows that 



, oo 

= A + (l-<(t))'^-l < 0. 



dt 
1=1 



Hence Yli^k '^ti^)' ^^'^ therefore X^^^ (t), is bounded by Y1T=1 ''^ki^) uniformly for all t. In turn 
equality ([9]) yields 



Jo 



oo 

< 

=k 



The bound on the right hand side is finite since v+(0) € Uo due to the hypothesis v(0) G Uq- Note 
that, owing to the inequality neither one of the two integrands above changes sign. Hence if the 
first integral converges as t ^ oo then so does the second one, implying further that 

\imv^it)=vl (10) 



t—*oo 



Since Vq (t) = Vq = 1, this is clearly the case for k = 1. Induction on k confirms that equality (jlOp 
holds for all k. The desired conclusion ([7]) now follows from the property ([8]). □ 

Theorem 13.11 which establishes convergence over finite time intervals, is complemented next by 
showing that equilibrium distribution of u(-) converges as n ^ cxd to the deterministic measure 
concentrated at v*. 

Theorem 3.2 The process u(-) is ergodic. Let u* = {u^}^q denote the equilibrium random 
variable. For e > 

lim P„(p(u*,v*) >e) =0. (11) 

n— >oo 

In particular lim^^oo En[u^] = v^. for /c = 0, 1, 2, • • • . 

Proof. Let f/„ = {u e [/ : nuk S Z+ for > 0}. Note that (u(t) : t > 0) is irreducible in 
Un and Un is compact; therefore the process is ergodic and has a unique equilibrium distribution 
concentrated on In that equilibrium the rate of arrivals to queues with occupancy k or higher 
should be equal to the rate of departures from such queues. That is, 

En[\ul_^] = l-En[{l-ulY] > En[ul], forfc>l, 

where the inequality follows since (1 — u^,)'^ < (1 — uD- Therefore £'„[n^] < and in turn 
En[ET=i K] < A/(l - A)- Let Uo,x = {u G f/ : , Uk < A/(l - A)} so that P„(u* G Uo,x) = 1- 
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Suppose that p!T]) is false so that for some infinite subsequence {n'} of {n} and some 6 > 

Pn'{p{n*,v*)>e)>S. (12) 

Due to Lemma 13.11 and compactness of Uo,\ one can choose t(e) such that if v(0) € Uo,\ then 
p(v(t),v*) < e/2 for t > t(e). Let u(0) have the same distribution as u* and let v(0) = u(0). 
By Theorem 13.11 there is a further subsequence {n"} of {n'} such that P„"(p(u(t(e)), v(t(e))) > 
e/2) < 6 whenever n" is large enough. Since P„//(u* G J^o.a) = 1, the choice of t{e) implies that 
i-!„//(p(u(t(e)), V*) > e) < 6 for those values of n". However u(t(e)) and u* have identical distributions 
as the latter is in equilibrium; leading to a contradiction with (jl2p . Hence no sequence {n'} and 
constant 6 > satisfy (fT2]) : so pT]) holds. By definition of p equality pT]) implies that each entry 
of u* converges in probability to the constant v^; since < < 1, so does -E'„[u^]. □ 

We conclude the discussion of LCQ((i) with a relationship between d and the tail probabilities of 
equilibrium queue occupancy: 



Theorem 3.3 vl = @{{X/d)'') as k ^ oo. 



Proof. The assertion is immediate for d = 1 so we consider the case d > 1. Equality ([6]), together 
with Taylor expansion of v^l — x around x = yields 



"j-y^-.+iE^no-i). (13) 

i=2 j=l 

The second term on the right hand side is nonnegative; therefore > {\/d)vl and 

liminf— ^>1. (14) 

We define Cfc = v^jiXjd)^ and complete the proof by showing that {c^j^Q is uniformly bounded. 
Let /3fc be defined as 

oo i+l oo 

/3, ^ l + ^(At;|_J^--— n(j-^) < \^Y.^\vl_^)' (15) 

i=l V J- i=l 



SO that equality (fTSll can be rearranged as 



-. = ^^.-i + ^^(l-^R. (16) 
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Since < there exists a finite kg such that vl_-^ < 1/d for k > kg- The bound in ([T5|) imphes 
that Pk < 1/(1 - A/d) < d/{d - 1) for such k; in turn by 



Ck < Ck-i + cl_i^{X/d)'', k > ko- 

It can be verified by induction on k > ko that 

Cfc <Cfc„(l + A + A2 + ... + A'=-^°) : (17) 

Namely, if (HZD holds for k then it holds also for + 1 if Cfc^(l + A + + ^ X^-''°fX''° /{2d'') < 1. 

This latter condition can be verified based on the bound Ck^{X/d)^° = Vk^ < l/d, which follows from 
the definition of ko- Inequality (llTh implies the uniform bound Ck < Ck„/{1 — A); therefore 



limsup < r;^. (18) 



(X/d)'' 1-X' 



The theorem follows due to (HD and ([181). □ 



4 LCQ 

Given m(r) at a scheduling instant r, the maximum occupancy over all connected queues at time r 
is equal to /c = 1, 2, • • • with probability (1 — q)"^k+ii-r) _ _ g^jm-feM. j^ence under the LCQ policy 
u(-) is a time-homogenous Markov process with jump rates 



u 



u + n ^e^ at rate nX{uk-.i — u^) 

(19) 

u - n-^Gk at rate n ((1 - g)"«fc+i - (1 - g)"«fe) . 



This process can be constructed as in Section [3l so that 

uk{t) = n,(0) + f {X{uk-i{s) - Uk{s)) - (1 - g)-'=+i(^) + (1 - (^)™'=(^)) ds + efc(t) (20) 





where efc(") is a martingale that vanishes as n ^ oo. The sequence of processes u(-) : n = 1, 2, • • • 
converges in distribution along subsequences of {n}, but identifying a limit is relatively more involved 
than for the LCQ(d) policy since the process m(-) fluctuates persistently for all values of n and the 
integrand in (j20p does not converge. Rather than this integrand, here we study the behavior of the 
integral in (|20p via an averaging technique due to Kurtz [5j. In reading this section the reader may 
find it helpful to consult related applications of this technique in [U [U [13] . 
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Let Q denote the set of sequences cj = {i^k}kLo such that ujk G 'Z+U{oo}, uq = oo, and ujk > ^fc+i- 
Define the mapping h : 0, [0, 1]°° by setting 

/iH = {(l + a;fc)-Hr=o, ^^^^ 

with the understanding that 1 + cx) = cx) and l/oo = 0. Let 0, be endowed with metric po defined by 

Po{uJ,(jL>') = p{h{u),h{u')), <jL!,uj'efl. 

In particular 0, is compact with respect to the induced topology. We denote by C the collection of 
measures p on the product space [0,cxd) x Cl such that p{[0,t) x Q) = t for each t > 0. Let C be 
endowed with the topology corresponding to weak convergence of measures restricted to [0, t) x 17 
for each t. Since O is compact, so is C due to Prohorov's Theorem. 

Let ^ be a random member of C defined by 

^{[0,t)xA)=[ l{ui{s) e A}ds, t>0,AeB(n). 
Jo 

Here B{n,) denotes Borel sets of il. Note that equality (|20p can be expressed in terms of ^ as 

ft 







Uk{t) = nfe(O) + / X{uk-i{s) - Ukis))ds - (j)k+i(t) + (pk{i) + £kit) 

where 



A 



(1 - qr^^'Us = I (1 - qy'Cids X du). 
J[o,t)xn 



'0 J[o,t)> 
Compactness of C implies that each subsequence of {n} has a further subsequence along which ^ 

converges in distribution. This property is also possessed by u(-), and therefore by the pair (u(-),^). 

The following definition is useful in characterizing possible limits of (u(-),^): For fixed u E [7 let 
a;"(-) denote the Markov process with states in Q and with the following transition rates: 



+ efc at rate X{uk-i — Uk) 

u ^'^^^ 
^ cj" - efe at rate (1 - gj'^fe+i - (1 - g)""". 

See Figure [3] for a partial illustration of this process. The process a;"(-) bears a certain resemblance 
to m(-) = nu{-), which can be observed by inspecting the generators (jl9p and (j2ip . though it should 
be noted that in (|2ip u = {ufcj^Q is a constant and has no binding to instantaneous values of 
We also point out that evolves on a compactified state space and it is reducible due to the 

states that involve oo; hence it has multiple equilibrium distributions in general. 
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J 

Figure 3: Transition rates of that is, the kih. coordinate of u;"(-). The process has also an 

isolated state oo which is not shown. The coordinate process is generally not Markovian due 

to its dependence on 

Theorem 4.1 Let (v(-),x) &e the limit o/(u(-),^) along a convergent subsequence of {n}. 

a) The limit measure x satisfies 

x{%t)xA)= [ TT^^sM)ds, t>0,AGB{n), 
Jo 

where, for each s > 0, '7Tv{s) o,n equilibrium distribution for the process uj^^^\-) such that 

7rv(s) {^k = oo) = 1 if Vk{s) > 0. 

b) The limit trajectory v(-) satisfies 

j^Vkit) = \{vk-i{t) - vm - i?.^(,,[(l - qr^^ - (1 - qn (22) 
where k = 1, 2, • • • and E-k^^^) denotes expectation with respect to distribution TT^^t) ■ 

Proof. Let all processes be constructed on a common probability space so that convergence of 
(u(-),^) is almost sure. Convergence of u(-) is then uoc. We start by consulting [5l Lemma 1.4] to 
verify that the limit measure x possesses a density so that 

x{%t)xA)= f -f,{A)ds, t>0, AGe(O), (23) 

Jo 

where, for each s, 7^ is a probability distribution on Vt. We proceed by identifying these distributions. 

Let T denote the collection of bounded continuous functions / : M such that /(cj) depends 
on a finite number of entries in the sequence a; = {wfclfc^o ^ Given / G JF define the function 
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G-f -.nxU ^Rhy setting 

oo 

Gfiu,u) ^ ^{fiu + efc) - /(c^))AK_i - Uk) + {f{u - e^) - /(c^))((l - qr>^^^ - (1 - qT") 



k=l 



for each a; G and u = {ufej^Q G ^7- G-^ is continuous due to the continuity of /, and continuity 
of is uniform since the product space Vl xU \s compact. 

The process /(m(-)) satisfies at each instant t 

/(m(t)) - /(m(0)) 

^(/(m(s) + efc) - f{m{s)))dAk-i i^J^ nA(ufc_i(r) - UkiT))dTj 
+ 5^(/(m(s) - e,) - f{^{s)))dD, ^ n ((1 - - (1 - 

„j oo 

= n y'(/(m(s) + efc) -/(m(s)))A(nfc_i(s) 
ft °^ 

+ nj^ Y^ifiMs) - ek) - /(m(5))) ((1 - ^ - (1 - + /(t) 



fc=i 



n 



G^(m(s),u(s))ds + /(t), 



where fJ.-^{-) is a square-integrable martingale. Rearranging the last equality and expressing the 
integral there in terms of the random measure ^ yields 

[ G^ {u,u{s))^{ds X du) = [ G^ {m{s),u{s))ds = (/(m(t)) - /(m(0))/n + /(t)/n. 
J[o,t)xn Jo 

Since / is bounded, the first term on the right hand side vanishes as n ^ oo. The martingale fi^ (•) 
has bounded jumps; in turn by Doob's inequality fj,^{t)/n also vanishes. Therefore 



/ Gf{u,u{s))Cidsxdu)^0. 



Since u(-) converges uoc to v(-) by hypothesis, uniform continuity of G^ implies 

Gf{u,u{s))^{ds xdu)- [ Gf{uj,v{s))^{ds x du) 
Finally by the Continuous Mapping Theorem 

f Gf {u, v(s))e(ds xdu)^ [ Gf {uj, v{s))xids x du). 



0. 



'[o,t)> 

Observations (l2l)-(I26l) lead to 



(24) 



(25) 



(26) 



/ G^ {LJ,v{s))x{ds X du) = [ V G^(cj,v(s))7,(u;)ds = 
J[o,t)xn Jo ^gf^ 
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where the left equality is due to (p3|) . This equality holds for all t > 0; therefore 

^G/(^,v(s))7,(cc;) = 

for almost all s > 0. Since f £ is arbitrary (note that is dense in continuous bounded functions 
on O) [2l Proposition 4.9.2] implies that 7^ is an equilibrium distribution for the process 

Let e > and [toj^i] be an interval such that v^it) > e for t G [toi^i]- Since Vkit) is the limit of 
Uk{t) = n~^mk{t), for any given integer B 

^([to,ti] X {0,1,2,- •• = / l{mk{s)<B}ds ^0 as n ^ 00. 

Jto 

Hence x([^0)^i] x Z^-) = due to the arbitrariness of B. Since e can be chosen arbitrarily small it 
follows that 7t(Z_|_) = for almost all t such that Vk{t) > 0. This completes the proof of part a). 
Part b) follows from equality (|20p since 

t rt 

{uk-i{s) - Uk{s))ds / - Vk{s))ds 

Jo 

due to uoc convergence of u(-), and 



,t)xn Jo 



due to the Continuous Mapping Theorem. □ 

Theorem 14.11 explains the extent of the disparity between time scales of two processes, namely 
m(-) and its normalized version u(-): The process m(-) displays far larger variation than its nor- 
malized version, so that, in the limit of large n, m(-) settles to equilibrium before u(-) changes its 
value. In particular integral of a binary- valued measurable function of m(-) is well-approximated 
by integrating an appropriate equilibrium probability. Provided that u(t) remains close to v(t), the 
process mimics a slowed-down version of m(-) observed around time t; hence the alluded 

equilibrium distribution pertains to u:^^^\-). 

Specification of requires inclusion of 00 since entries of m(-) can be as large as n. 

Compactifying the augmented state-space Q of m(-) via choice of the metric po leads to the repre- 
sentation (j22p of a limit trajectory v(-), but it also entails ambiguity in that representation. Namely, 
Theorem 14.11 does not specify which equilibrium distribution for uj^^^\-) should be adopted in ()22p . 
While a full account of equilibrium distributions of uj^^^\-) appears difficult, an important feature of 
the right distribution can be identified: 
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Lemma 4.1 Let v(-) and tt^^.) he as specified by Theorem \4-l\ Given k = 1,2, •• • 



vrv(t) {uJk e Z+ and cj^+i = 0) = 1 
for almost all t such that Vk{t) = 0. 

Lemma 14.11 will be instrumental in obtaining a sharper description for v(-), yet an informal 
explanation may still be useful in putting it in perspective with the queueing system of interest. 
Note that if Vk{t) = and Vk-i{t) > then ^^{t) reflects a distribution with support {0, 1, • • • ,k — l}. 
This property does not immediately translate into a bound on the maximum queue length in the 
system, since v(t) is the limit of u(t) = n~^m(t) and so the number of queues with at least i > k 
packets, mi{t), is o{n) as n — > oo. By way of interpreting a;^''*)(-) as a proxy to m(-) around time t. 
Lemma 14.11 indicates that the maximum queue size is at most one larger than what is deduced from 
v(t) and that the number of maximal queues is 0(1) as n — > oo. 

Proof of Lemma 14.11 Let [toj^i] be an interval such that Vk{t) = for t G [to,ii]- We prove the 
lemma by showing that as n — > oo along the convergent subsequence of interest 



For each integer / and time t let si{t) = X^i^/ fni{t)- This quantity increases when some queue with 
size at least / — 1 receives a packet, and it decreases when transmission is scheduled from some queue 
with size at least I. Given u{t), these events occur at respective instantaneous rates nXui-i{t) and 




to 



(27) 



(28) 



n 



(l - (1 -5)'"'W). Therefore 




(29) 



Consider this equality for I = k + 1. By choice of the interval [to, ^i] 



oo 



n En[sk+i{t)] 



i=k+l 



and Uk{t) Vk{t) = for all t £ [tQ,ti]. Consequently 
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This leads to (1271) since 



To complete the proof, note that n~^En[skit)] for all t S [to)*i]; therefore (p9]) evaluated at 
I = k implies that for any open subset B C [toi^i] 



lim sup E„ 

n— ►oo 



J (i - (1 - ^r^w) 



lim sup E„ 

n^oo 



Xuk-i{t)dt 



B 



< / dt. 

IB 



The last inequality is strict since A < 1. Arbitrariness of B implies (j28p . 



□ 



Given positive integer K let Uk = {u € U : = for k > K}. 

Theorem 4.2 Let v(-) and 'n'v^.) be as specified by Theorem \4-l\ with initial state v(0) G Uk for 
some K . Then for t > 

a) v(t) e and 

7rv{t) (wii-(i) e ^+ and ujK{t)+i = O) = 1 
where K{t) = min{A; : Vj{t) = for j > k}. 



b) 



d I \vu-i{t)-l<Q ifk = K{t)-l 



dt 







ifk> K{t). 



In particular Vk{t) = for A; > and t > K/{1 — A). 



Proof. Let t be an instant such that K(t) < oo. Lemma |4. 1 1 implies that 



7rv(t) {^K{t) G ^+ and ujK{t)+i = O) = 1. 



In particular the coordinate process a;^^*]^(-) possesses an equilibrium in Z+. The process should 
have equal rates of up-jumps and down-jumps in that equilibrium, namely 



(30) 



^-v,.,[(l-9r^'*^] = l-At;/<(i)_i(t). 
Since > by definition of K{t), Theorem I4.1[ a implies that 



(31) 



(32) 
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Substituting ([3T]) and ([32]) in equality ([22]) evaluated at A; = — 1 yields 

f^VKit)-l{t) = ^VK(t)-2{t) - < 0. (33) 

Note also that E^^^^^[{1 - = 1 due to ([30|); hence equality ([22|) for A; = K{t) gives 

J^^K(t)it) = -^VKit)it) = 0. (34) 

Since K{0) = < cxd by hypothesis, it follows via (|33|) and (|34|) that i^(t) is finite and nonincreasing 
in t. Part (a) of the theorem now follows by (|30p . Part (b) is due to ([33p and (|34p . □ 



Corollary 4.1 //u(0) G [/a' /o?^ some ivT then 

lim P„(mi(t) G Z+,m2(t) = 0) = 1 (35) 

for t > K/{1 — A). The system occupancy Y1T=1 ''^k{t) converges in distribution to the equilibrium 
value of a birth- death process with constant birth rate A and death rate 1 — (1 — g)-' at state j. 

Proof. Let {rij} be a subsequence along which (u(-), ^) converges and let (v(-), x) denote the limit. 
Since u(0) G Uk it follows that v(0) G Uk- Choose ti > to > - A) so that by Theorem liT2lb 

v(t) = {1,0,0,0, - •• } for t G [to,ti]. Let A = {u gQ-.ljiG Z+,W2 = 0}. Then 



/ Pn,{m{t)^A)dt = Err^ j l{m(t) G ^ I Tr^(^tj{A)dt = ti-to, 

J to L'^ tl) J J to 



where the last equality is due to Theorem I4.2i a. The above limit does not depend on the particular 
subsequence {nj}; therefore ([35p follows. The final claim of the corollary is verified by observing that 
for t > K/{\ — A) the coordinate process 1^2*^*'* = in equilibrium; and in turn lj^^*^ is a positive 
recurrent birth-death process on Z+ with birth rate A and death rate 1 — (1 — g)-' at state j. □ 

It should be noted that the hypothesis u(0) G Uk is necessary for the conclusions of Corollarv l4.1l 
If the initial size of a single queue is allowed to grow without bound with increasing n then, for large 
values of n, that queue receives service whenever it is connected. In effect this reduces the service 
rate available to the rest of the system by a factor of (1 — (7). In such degenerate cases the present 
analysis applies to the subsystem that is composed of queues with bounded initial occupancies, after 
appropriate adjustment of the service rate. 
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5 Final remarks: LCQ((i„) 



Conclusions of Sections [3] and H] reveal that the system occupancies under LCQ((i) and LCQ differ 
by a factor of order n as n — > oo. More insight on this disparity, especially for moderate values of 
d relative to n, can be gained by considering an asymptotic regime in which d is allowed to depend 
on n. Here we sketch asymptotic analysis of LCQ((i„) in the case 

lim dn = oo and lim — = 0. 

n— >oo n^oo n 

The present discussion closely follows that of Section SI hence proofs are omitted. 
Under LCQ((iri) the representation (j4]) can be expressed as 
Uk{t) = nfc(O) + (aK_i(5) - nfc(s)) - (^(1 - ^-h±M)dr. _ (i _ ^-^f-^^ ds + efc(t) 

where bk{t) = dnUk{t). Let b(t) = {fefe(i)}^Q and let Qq be obtained by augmenting Q with nonin- 
creasing sequences that take values in M^- U {oo}. Define the random measure by 

^o{[0,t) X A) = [ l{h{s)eA}ds, t>0,AeB{no). 
Jo 

Consideration of the pair (u(-),^o) via an analogue of Theorem 14.11 identifies possible limits v(-) of 
u(-) as solutions to 

j^Vkit) = X{vkMt) - Vk{t)) - E^^^^^[e-^^+^ - e-^"], = 1,2, • • • 

where 7rv(t) is a distribution on such that 7rv(j)(wfc = oo) = 1 if Vk{t) > and 

E^^^^^ [l{ujk + oo} {\(vk-x{t) - Vk{t)) + e-"'= - e-'^'^+i)] = 0. 

The line of reasoning employed in establishing Lemma l4.ll and Theorem 14.21 readilv applies to v(-) 
and 7rv(.) here, yielding that 

7rv(t) i^k G 1R+ and uJk+i = 0) = 1 if Vk{t) = 0, 

and that vi{t) = for t > i^(0)/(l — A). In turn for such t, bi(t) = 0(1) and b2{t) = o(l) as n — > oo. 
The maximum queue size in equilibrium therefore tends to one, but the number of queues at that 
occupancy is substantially larger than the same number under the LCQ policy. In particular for 
large enough values of t the total system occupancy Ylk>i ™'A:(*) = (n/dn) J2k>i ^k{i) is 0{n/dn)- 
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